Intelligent agent features for wearable personal communication nodes

ABSTRACT

Systems, methods, apparatus and software enable intelligent agent features for user nodes that are members of a communication group. Instructions instantiate an intelligent agent node as a member of the communication group. Each intelligent agent node can be instantiated by a communication group management system, an intelligent agent system and/or by one or more of the communication group members, for example by executing software on one or more computing systems or devices. A variety of services and other assistance can be provided by intelligent agent member nodes, including recording communications, auditing communications, providing audio transcription, annotating media, and paging communication devices, including communication nodes that are not members of the communication group. Communications between personal communication nodes and any intelligent agents can be secure.

RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/166,531, filed on May 27, 2016, entitled “INTELLIGENT AGENT FEATURESFOR WEARABLE PERSONAL COMMUNICATION NODES,” which claims the benefit ofand priority to U.S. Provisional Patent Application No. 62/166,859,entitled “INTELLIGENT AGENT FEATURES FOR WEARABLE PERSONAL COMMUNICATIONNODES,” filed May 27, 2015. Each patent application identified above isincorporated herein by reference in its entirety for all purposes.

TECHNICAL FIELD

Aspects of the disclosure are related to communications and, inparticular, to intelligent agents usable with communication groups.

TECHNICAL BACKGROUND

Telephones, cellphones, smartphones, computers, and tablets provide anefficient way for users to communicate without being in the samephysical location. However, these devices often require the user toprovide multiple inputs and preferences for each of the communicationsbefore the communications can take place. Such preferences may includeidentification of the individuals involved in the communication, acontact identifier for the individuals in the communication, amongst avariety of other preferences. Moreover, when busy performing othertasks, it is often difficult to interface with the device (e.g., inchanging environments, locations and conditions) while concurrentlyholding a communicating phone, computer, or tablet, and may distract theuser from a current task or situation.

OVERVIEW

Implementations providing intelligent agent features to personalcommunication nodes (e.g., wearable personal communication nodes)include systems, methods, and software that receive instructions toinstantiate one or more intelligent agent nodes as members of acommunication group that includes the personal communication nodes. Eachintelligent agent node can be instantiated by a communication groupmanagement system, an intelligent agent system and/or by one or more ofthe communication group members, for example by executing software onone or more computing systems or devices. A variety of services andother assistance can be provided by intelligent agent member nodes,including recording communications, auditing communications, providingaudio transcription, annotating media, and paging communication devices(including communication nodes that are not members of the communicationgroup). Communications between personal communication nodes and anyintelligent agents can be secure (e.g., using encryption).

This Overview is provided to introduce a selection of concepts in asimplified form that are further described below in the TechnicalDisclosure. It may be understood that this Overview is not intended toidentify or emphasize key features or essential features of the claimedsubject matter, nor is it intended to be used to limit the scope of theclaimed subject matter.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a communication system.

FIG. 2 illustrates an intelligent agent system.

FIG. 3 illustrates a method of operating a communication system.

FIG. 4 illustrates a computing system.

FIG. 5 illustrates a communication system.

DETAILED DESCRIPTION

Personal communication devices (e.g., cellphones, smartphones, gamingdevices, personal computers, tablet computers) can include various voicecommand features (e.g., keyword-based searching, productivityassistance, or navigation assistance). Further features can includeconversational interaction for information transmittal or retrieval,such as activity reminders, weather, stocks, messaging, email, calendar,contacts, notes, music, clocks, web browsers, maps and otherapplications. Using implementations of intelligent agent featuresdisclosed and claimed herein, personal communication nodes can interactwith one or more intelligent agents that are members of and/or otherwiseincluded in communication groups formed of and containing multiplecommunication nodes. Additionally, such intelligent agents may bevirtualized and established in some non-limiting examples as securemembers of a communication group for secure (e.g., encrypted) group nodecommunications (e.g., establishing auditing, secure recording, or secureassistance features among group members.

FIG. 1 illustrates an exemplary communication system 100 in whichintelligent agent features can be established for personal communicationnodes 102, 103, 104. System 100 includes nodes 102-104, managementsystem 120, and agent system 130. Personal communication nodes 102-104can operate in groups (e.g., Group A and Group B of FIG. 1). Thesegroups may be defined by management system 120 based on one or morefactors (e.g., dynamic attributes communicated to management system 120from nodes 102-104 or monitored by system 120). Groups A and B may eachcomprise a nexus of specified nodes 102-106 (e.g., for interactivecommunications, information sharing, data exchange, and other mutualexchange).

Personal communication nodes 102-104 may each comprise transceivers,audio transducers, processing systems, communication interfaces,environmental sensors, accelerometers, gyroscopes, Global PositioningSystem (GPS) receivers, user interfaces, and other systems (including,in some implementations, a computing system to assist in implementingeach node). In some implementations each personal communication nodecomprises a wearable push-to-talk communication device.

Management system 120 may comprise a computing system comprising one ormore computing devices capable of managing services to one or morecommunication groups, each of which may comprise a plurality of personalcommunication nodes, such as personal communication nodes 102-104, aswell as one or more intelligent agent nodes, such as node 106.Intelligent agent features discussed herein may be executed on personalcommunication nodes 102-104, management system 120, or agent system 130,including combinations and variations thereof.

Personal communication nodes 102-104 communicate with each other overassociated links 141-147. These associated links 141-147 also can beused to communicate with other personal communication nodes and/orintelligent agents. Nodes 102-104 also can communicate with managementsystem 120 over associated ones of links 140-143. Management system 120communicates with personal communication nodes communication via link140, which can comprise one or more network links in this example. Insome implementations links 140-147 can connect personal communicationnodes 102-104 to management system 120 and agent system 130 using one ormore wireless links that can each comprise Long Term Evolution (LTE),Global System For Mobile Communications (GSM), Code Division MultipleAccess (CDMA), IEEE 802.11 WiFi, Bluetooth, Personal Area Networks(PANs), Wide Area Networks, (WANs), Local Area Networks (LANs), orWireless Local Area Networks (WLANs), including combinations,variations, and improvements thereof. These links can carrycommunication protocols suitable for wireless communications, such asInternet Protocol (IP) or Ethernet. Additionally, links 140-147 caninclude one or more wired portions which can comprise synchronousoptical networking (SONET), hybrid fiber-coax (HFC), Time DivisionMultiplex (TDM), asynchronous transfer mode (ATM), circuit-switched,communication signaling, or some other communication signaling,including combinations, variations or improvements thereof. In someexamples, communication links 141-145 connect personal communicationnodes 102, 103, 104 to each other and/or to other communication nodes.Links 141-145 can comprise Bluetooth, IEEE 802.11 WiFi, infrared,ultrasonic, or any wireless communication format including combinations,variations or improvements thereof. Communication links 140-147 can eachuse metal, glass, optical, air, space, or some other material as thetransport media and may each be a direct link, or may includeintermediate networks, systems, or devices, and may include a logicalnetwork link transported over multiple physical links.

Each personal communication node 102-104 in FIG. 1 may be configured toobtain (e.g., monitor, collect or receive) attribute information, forexample by monitoring one or more attributes from associated positionalsensors, audio transducers, GPS receivers, accelerometers, wirelesstransceivers, environmental sensors, or other devices capable ofmonitoring the types of attributes discussed herein. Attributeinformation can comprise any data or other information that may be useddynamically to form, terminate and change groups of nodes, as well asfor implementing intelligent agent features for personal communicationnodes 102-104. For example, data and/or other information about thesound level of an environment, user preferences, proximity of onepersonal communication node to another, location, communication status,identity, and/or traveling speed may be used for dynamic formation,termination and changing of node groups, as well as for intelligentagent features for personal communication nodes 102-104.

Personal communication nodes 102-104 can periodically transfer messagesfor delivery to management system 120 containing or otherwise indicatingattribute information (e.g., dynamic changes in one or more attributes).For example, in some non-limiting examples, nodes 102-104 can transfer amessage to management system 120 (e.g., periodically and/or when anattribute changes) so that management system 120 can use such attributechanges to form communication node groups and/or to provide intelligentagent features for such nodes. Although management system 120 and agentsystem 130 are shown as separate entities in FIG. 1, it should beunderstood that features of management system 120 and agent system 130can be combined into a single entity or unit, can be included in one ormore of personal communication nodes 102-104, or can be implemented inany other suitable fashion.

In addition to forming groups composed solely of personal communicationnodes, such as Group A containing nodes 102-104, groups also may beformed in system 100 of FIG. 1 that include an intelligent agent nodesuch as node 106, which assists group members, (e.g., providingautomated assistance, actions and/or services). In FIG. 1, intelligentagent node 106 is included as a member of a communication Group B, whichalso includes at nodes 102, 103, 104, although any number of personalcommunication nodes can be included. Similarly, Group A comprises nodes102-104 (e.g., the group may be based on dynamic attributes). A memberof Group A (e.g., node 102, node 103 or node 104) may want or need toadd an intelligent agent to assist one or more members of Group A, andthus intelligent agent node 106 can be added responsively to form GroupB in FIG. 1.

Node 106 can assist and/or perform services for personal communicationnodes (e.g., auditing features, audio recording, and voice-command-basedassistance features, among others). As shown in FIG. 1, communicationlinks 146 and 147 relate to node 106, though these links can be includedin portions of links 140-145. Links 146-147 and others show non-limitingexamples of communicative relationships between members of Group B andagent system 130. Furthermore, intelligent agent features of node 106can be included and executed in one or more of communication nodes102-104, management system 120, and/or agent system 130, and indistributed implementations using two or more of these components,including combinations and variations thereof.

Intelligent agent features may be customized by agent system 130 to meetspecific duties, needs, limitations, etc. of a group. For example, inone non-limiting example Group B may comprise a team of firefighters.Intelligent agent features can be adapted by agent system 130 to use anatural language interface via node 106 to provide information about thefire as well as information regarding the actions and locations of otherfirefighters and other responders. Intelligent agent features providedby node 106 and/or system 130 of FIG. 1 can include recordingconversations among users of nodes 102-104, auditing communicationsexchanged between nodes 102-104, providing voice-based assistance andservices to nodes 102-104, and other features. It should be understoodthat, just like personal communication nodes, intelligent agent nodeslike node 106 can be members of multiple groups. For example, in theexample of a fire to which firefighters are responding, a givenintelligent agent node might be a member of a first group made up offirefighters, a second group made up of medical response personnel, anda third group made of law enforcement personnel, where the singleintelligent agent node provides the same or different features to eachgroup. Similarly, a single group might include multiple intelligentagent nodes, each intelligent agent node being instantiated for aparticular purpose or by distinct members of the group which they serve.

Personal communication nodes may communicate securely with each other sothat authorized users and their respective nodes can securely sharecommunications, data and other information without unauthorizedinterception or monitoring of the information or associatedcommunications (e.g., by non-group-member nodes and/or third parties).FIG. 1 shows secure communication link 147 connecting agent system 130to nodes 102-104; one or more of the other links 140-146 in FIG. 1 canlikewise be secured. Secure communication may comprise symmetric keyencryption, asymmetric key encryption, public-key encryption, or someother type of encryption, including combinations thereof. Both thecontent of communications and the transmission links between personalcommunication nodes can employ secure communication techniques, methods,etc.

Moreover, end to end encryption of communications such as audiocommunications can be established and utilized among members of thegroup. Such end-to-end encrypted communications can include transportlayer security (TLS), secure sockets layer (SSL) communications, and/orany other suitable secure link types. For example, a securecommunication session can be established among an original node group(Group A) including nodes 102-104 in FIG. 1. Node 102 can initiate anintelligent agent, resulting in instantiation of node 106 as a member ofa new group (Group B) that likewise includes nodes 102, 103, 104. As theintelligent agent initiating node in this non-limiting example, node 102can authorize node 106 to engage in a secure communication session ofGroup B members (e.g., by performing a security handshake and/orinvolving node 106 to introduce node 106 into the secure communicationsession between and among nodes 102, 103, 104). In some implementations,group members and/or a management system may have a preselected protocolthat automatically instantiates or executes an intelligent agent (e.g.,an intelligent agent node) once a secure communication session isestablished between nodes, which can be useful in environments where asecure recording or other record is to be made of meetings or groupcommunications (e.g., in a corporate setting and/or public agencyoperation such as law enforcement and first responder activities). Insome such implementations, groups including law enforcement orgovernment agency personnel may instantiate a group intelligent agent tomonitor and record communications for compliance, auditing andevidentiary purposes.

Node 106 can be executed on a single processing or computing system,such as agent system 130, or can be executed across multiple processingand/or computing systems. In some implementations, node 106 may beexecuted as a virtual node comprising software or firmware executed byone or more of nodes 102-104 or management system 120 in FIG. 1. Inother implementations node 106 can comprise virtualized softwareexecuted by a virtual machine that is instantiated upon demand by any ofnodes 102-104. This virtual machine can be executed on one or more ofthe computing or processing elements of FIG. 1, such as nodes 102-104,management system 120, or agent system 130. In some implementations, auser or node 102-104 can specify where and/or how node 106 is to beexecuted (e.g., by selecting a specific host node or host computingsystem, or by specifying a physical location, where specified locationscan include a home or business server, a country of execution fordistributed computing systems, and others). Moreover, when node 106generates data and/or other information to be recorded, any of node102-104 or management system 120 can specify where the records and/orother data are to be stored (e.g., in a digital storage device,computer-readable medium associated with a particular computing node, alogical location, and/or a physical location).

Node 106 also can implement assistance features for communication groupmembers. For example, a voice recognition assistance feature allowsmembers to utilize voice commands (e.g., to perform search operations,add or remove nodes from group membership (including node 106), initiateor alter secure communication links or parameters, and annotate incomingcommunications). Additional features can include voice-based and/oraudible interaction for information transmittal or retrieval (e.g.,activity reminders, weather reports, stock information, messaging,email, calendar, contacts, notes, music, clocks, web browsers, maps andother applications).

Intelligent annotation features can also be performed by node 106, suchas audio transcription of communications that are not initially receivedin an audio format. For example, email messages, text messages, calendarevents, announcements, alerts, computer code, and/or other numeric,textual and data communications can be transcribed into an audio formatby node 106. Audio transcription can comprise variable voice features(e.g., different speeds, tones, languages, dialects).

In some intelligent agent implementations, received images, video and/ormultimedia content can be conceptually transcribed or annotated. When auser of one of nodes 102-104 receives content, the user can initiate anintelligent assistant, such as node 106, which can transcribe thecontent descriptively to the user in an audio format. In cases whereimages, video or other content does not have associated text, node 106can employ audio descriptors for the content. Images can be evaluated byan intelligent agent using object detection and pattern matchingperformed to establish textual content associated with objects,patterns, symbols, characters, or other content within the images. Thistextual content can then be transcribed to an audio format for playbackby a node 102-104. Similarly, images in video content can be evaluatedbased on individual frames processed as images (though additional audiotracks associated with video content may be synchronized to a givenaudio transcription or annotation). Other content types can be processedto generate descriptive audio for a personal communication node user.

In other non-limiting examples, node 106 can provide group context-awareintelligent agent features. When, as in Group A of FIG. 1, acommunication group includes more than one node, intelligent agent node106 can be instantiated by any of the group's member nodes. Once theintelligent agent is instantiated, in some implementations any of themember nodes can use it to obtain information about other group members.For example, the user of node 102 can verbally query node 106 to obtaininformation on the current location of node 103. The intelligent agentof node 106 can then respond verbally to group members, supplyinginformation on the current location of node 103 (e.g., a relativelocation (e.g. “500 meters north of node 102”) or geographic coordinates(e.g. GPS coordinates, street address information, or intra-buildinglocations such as conference room identifiers or room numbers). Thelocation information can further include motion, route, or directionalinformation as well. In some implementations node 106 can also respondto requests for current group assignments. For example, the user of node102 can ask for a list of communication groups in which node 104 is amember, and the intelligent agent can respond accordingly. Otherinformation such as communication status, wireless connectivity status,or other information about a particular node can be requested throughthe intelligent agent (e.g., information monitored by node devicesensors or systems).

A communication node also can request that the intelligent agent issue apage or alert to a node that is not a member of the currentcommunication group. A node responding to the page might join theexisting group or might create a new group that includes one or moremembers of the current communication group. In some of these groupcontext examples, the requesting node is not required to supply groupidentification information for the node being paged. The intelligentagent can determine which communication group(s) the requested nodebelongs to and subsequently initiate appropriate action. In exampleswhere audible paging is implemented, for example, the intelligent agentmay either join the requested node's group, instantiate itself withinthat group, or instantiate a new, distinct intelligent agent in theother group. For example, if a paging node instantiates the intelligentagent in a first group and pages a node in a second group, theintelligent agent can automatically identify the paged node's groupbased on the paged node's identity alone. The intelligent agent can thenestablish an appropriate presence in the second group and page theappropriate node (e.g., using audible paging).

FIG. 2 illustrates exemplary systems 200 implementing intelligent agentfeatures for use by personal communication nodes (e.g., nodes 102-104 ofFIG. 1). In FIG. 2, intelligent agent 230 is shown either as beingincluded in software 225 executed by intelligent agent system 210 or asbeing software executed as a virtual node. Agent 230 can comprise node106 of FIG. 1.

Intelligent agent system 210 comprises processing system 220 andcommunication system 221 which are implemented in and/or otherwiseprovided by one or more computing and communication systems—system 220and system 221 are shown as separate systems, though they may becombined and/or implemented in one or more computing systems. Oneexemplary implementation node 201 (which may comprise one of nodes102-104 of FIG. 1) comprises intelligent agent system 210 that includes,implements, deploys or otherwise generates intelligent agent 230. Inanother example, intelligent agent 230 is a virtual node and comprisessoftware executed by a personal communication node or by anothercomputing system or device, such as agent system 130 of FIG. 1. Variouscombinations of one or more personal communication nodes, one or morecomputing devices, and/or one or more computing systems can executeintelligent agent 230. In some implementations intelligent agent system210 is a virtual machine that includes the elements of intelligent agent230 (e.g., where the virtual machine and intelligent agent system 210are executed in a distributed computing environment, such as a cloudserver or cloud system). Although the term intelligent agent is usedherein, other terms may be applied instead, such as robot assistant, botnode, virtual assistant bot (vot), Echo node, virtual assistant node,and/or other terms.

Processing system 220 includes user interface system 222, processingcircuitry 223 and storage system 224. Storage system 224 stores orotherwise includes software 225 that comprises intelligent agent 230.One or more of the elements of intelligent agent system 210 can beomitted in some examples; similarly, additional elements may be presentin given implementations of system 210.

Communication interface system 221 can comprise one or more wireless orwired transceivers for communicating with other devices and systems overone or more wireless or wired links. Example communication links includeBluetooth communication links, WiFi links, infrared links, ultrasoniclinks, or any other suitable communication link. In some implementationsthe links comprise virtual or logical links between various softwaremodules (e.g., when intelligent agent 230 is included in the software ofa personal communication node). When information is exchanged in some ofthese implementations (e.g., over the links associated withcommunication system interface 221), information exchange may occur inaccordance with any of a variety of protocols, including FTP (filetransfer protocol), HTTP (hypertext transfer protocol), HTTPS (HTTPsecure), SOAP (simply object access protocol), REST (representationalstate transfer), WebSocket, DOM (Document Object Model), HTML (hypertextmarkup language), CSS (cascading style sheets), HTML5, XML (extensiblemarkup language), JavaScript, JSON (JavaScript Object Notation), andAJAX (Asynchronous JavaScript and XML), as well as any other suitableprotocol, variation, or combination thereof.

Processing circuitry 223 can comprise microprocessors, microcontrollers,and/or other circuitry that retrieves and executes software 225 fromstorage system 224. Processing circuitry 223 may comprise a singledevice or can be distributed across multiple devices, including devicesin different geographic areas. Processing circuitry 223 may be embeddedin various types of equipment.

Storage system 224 comprises a non-transitory computer readable storagemedium, such as a disk drive, flash drive, data storage circuitry, orsome other hardware memory apparatus. Storage system 224 may comprise asingle device or can be distributed across multiple devices—includingdevices in different geographic areas. Storage system 224 may beembedded in various types of equipment. In some examples, a computerapparatus can comprise processing system 223, storage system 224 andsoftware 225.

Software 225 comprises intelligent agent 230 in some implementations.Intelligent agent 230, as shown in this non-limiting example, includesvoice recognition module 231, assistant module 232, audit module 233,recording module 234, and security module 235. In addition, software 225(including intelligent agent 230) may include operating systems,utilities, drivers, network interfaces, applications, and othersoftware.

Voice recognition module 231 provides a natural language interface thatallows a personal communication node user to issue verbal and/or otheraudible instructions to and receive feedback from intelligent agent 230.Voice recognition module 231 monitors for voice instructions captured bypersonal communication node audio transducers. Instructions aretranslated into digital instructions by voice recognition module 231 andtransferred, as necessary, to any of the other modules of intelligentagent 230. Voice recognition module 231 can adapt to individual languageusage and preferences. Using voice commands, an end user can dictateinstructions in natural language to a personal communication node. Theseinstructions may comprise questions or commands which are handled byintelligent agent 230. Additionally, a specialized voice instruction setcan engage various features of intelligent agent 230 (e.g.,instantiating intelligent agent 230, establishing a secure communicationgroup that includes intelligent agent 230, auditing communications, andrecording communication group audio).

Assistant module 232 receives digital instructions and other information(e.g., from voice recognition module 231, from user interface system222, and other sources). Such digital instructions can instructassistant module 232 to perform a given task or service (e.g., a keywordand/or Internet search for content or information, audio transcriptionof communications 232A, or media received by a personal communicationnode (e.g., audio transcription of images or video content),calendaring, meeting creation, scheduling, purchasing, recommendations,and mapping).

Audit module 233 performs auditing of audio communications betweenpersonal communication nodes, such as auditing communication groupmembers based on the identities of users and/or associated personalcommunication nodes. Auditing can include logging and/or tracking ofvarious properties of communications between communication nodes and/oran intelligent agent 230 (e.g., tracking and storing information relatedto physical locations, network locations, group participant/membership,time/day of communications, duration of communications, content ofcommunications, correlation of communication sessions to events (e.g.,emergency or planned events)). Each personal communication node canestablish individualized auditing and audit records 233A regarding theaudited communications and associated audit information can be stored.

Recording module 234 records audio associated with communications ofpersonal communication node groups (e.g., conversations and transmittedmedia). Recording module 234 can record audio responsive to voicecommands received by intelligent agent 230, or responsive to keywordstranscribed from audio communications. Furthermore, a textualtranscription of the audio communications can be stored along with theaudio (e.g., where the transcription is identified based on the contentof the audio communications). Each personal communication node may beable to utilize individualized recording. Moreover, secure storage 234Acan store recorded communications and associated transcript information(e.g., encrypted versions of communications).

Security module 235 performs one or more security processes (e.g.,handshaking 235A), permitting intelligent agent 230 to operate as asecure or encrypted member of a communication group that includespersonal communication nodes. An asymmetric or symmetric encryptionprocess or security key exchange can be utilized to securecommunications exchanged between and among intelligent agent 230 andcommunication group members.

FIG. 3 illustrates some implementations of the operation of intelligentagent features for personal communication nodes. Intelligent agent 330of FIG. 3 may be similar to agent 230 of FIG. 2 and may be an example ofintelligent node 106 of FIG. 1, however intelligent agent 330 may havealternative configurations and methods of operation. Intelligent agent330 can comprise software executed by personal communication nodes,agent systems, and/or management systems. An end user can interact withintelligent agent 330 through a personal communication node 304, whichmay be an example of node 104 of FIG. 1. Other nodes that are members ofa communication group that includes node 304 can also interact withintelligent agent 330 in FIG. 3 because intelligent agent 330 is acommunication group member that can share audio communications with allgroup members. Thus, using Group B of FIG. 1 as a non-limiting example,commands or instructions issued through node 102 of Group B can also bereceived and handled by the intelligent agent instantiated by node 104.In other implementations, only the instantiating personal communicationnode has access to the associated intelligent agent. Likewise, in otherimplementations, each node in a communication group may have one or morecustomized intelligent agents instantiated for an individual node'sutilization.

FIG. 3 illustrates the operation of an intelligent agent in connectionwith group communications in which node 304 is a member. Node 304 may bean example of personal communication nodes 102-104 of FIG. 1; howeverpersonal communication node 304 may have alternative configurations andmethods of operation. Likewise, intelligent agent 330 of FIG. 3 is anexample of an intelligent agent user node 106 of FIG. 1 or anintelligent agent user/virtual node 201 of FIG. 2, an intelligent agentsystem 210 of FIG. 2, or an intelligent agent software implementation230 of FIG. 2; however, intelligent agent 330 may have alterativeconfigurations and methods of operation.

In FIG. 3, node 304 instantiates (342) intelligent agent 330, whichincludes voice recognition module 331, assistant module 332, auditmodule 333, recording module 334 and security module 335. The user ofnode 304 queries intelligent agent 330 by transmitting a verbal query(344). Voice recognition module 331 processes the verbal query andconverts it into a data query that is transferred (346) to assistantmodule 332. Assistant module 332 analyzes the data query and performs anInternet search (348) that yields search results that are returned (350)to the assistant module 332 for node 304 (and other members of thecommunication group to which node 304 belongs). These search results canbe presented audibly (and/or in other formats) by intelligent agent 330.Assistant module 332 formulates an answer based on the search resultsand communicates the answer (352) to node 304 (and/or to othercommunication group members).

Assistance and services other than Internet searches can be performed byintelligent agent 330 and assistant module 332. In another non-limitingexample the user of node 304 might want to make dinner reservations andso poses a verbal request for restaurant recommendations to the user'spersonal communication node. Voice recognition module 331 processes thequery into a data query format, then transfers the data query toassistant module 332, which can perform a search of various networkedsystems for restaurants, receive the search results, formulate an answeroffering several responsive restaurant choices, and the communicate theanswer to the end user who chooses one of the restaurant choicesprovided by assistant module 332. The user may then verbally request adinner reservation to be made, which voice recognition module 331receives and processes into a data request. The data request is sent toassistant module 332, which formulates a service confirmation responseand sends the service confirmation to the end user, notifying the userthat the dinner reservations have been successfully scheduled. Thedinner reservation example presented above is non-limiting and merelyone of many services that intelligent agent 330 can perform. Otherexamples include purchasing tickets, retrieving a weather forecast,contacting roadside assistance or emergency response teams, and making acalendar entry.

In another non-limiting example illustrated in FIG. 3, node 304instantiates intelligent agent 330 as a secure agent (372) for secureparticipation in the communication group to which node 304 belongs.Voice recognition module 331 can identify this request for a securecommunication session with intelligent agent 330, and (after anyrequired data conversion) forward the request (373) for handling bysecurity module 335. Security module 335 responds to the request byperforming a security authorization (374), which can be a securityhandshake or the like (e.g., to grant access and participation in GroupB of FIG. 1 as a secure participant). This security authorization can beperformed through node 304 (e.g., by having node 304 exchange securitykeys with intelligent agent 330) to allow intelligent agent 330 toparticipate in secure (e.g., encrypted) group communications. In otherexamples, the security authorization is performed with a managementsystem, such as management system 120 of FIG. 1, or with a security nodethat handles security for personal communication nodes and intelligentagents.

Once intelligent agent 330 is authorized as a secure communication groupmember, various functions can be performed. In one non-limiting example,secure recording (376) of communication group communications can beperformed by recording module 334 (e.g., by recording audio exchangedwithin the group). The recorded communications can be encrypted (e.g.,using a security key specifically used by the communication group).Furthermore, secure auditing (378) of communications can be performed byaudit module 333. This auditing can include the functions describedherein for audit module 333, such as auditing use of security featuresand/or security keys used in communications.

Intelligent agent 330 can be terminated (380) after the variousfunctions are completed. In some examples, a vocal keyword or command istransmitted by node 304 or another node to terminate execution ofintelligent agent 330. In other non-limiting examples, intelligent agent330 auto-terminates upon completion of a particular task or activity orafter a specified time period. Once terminated, a security credentialfor intelligent agent 330 can be revoked. Any information generatedduring the operation of intelligent agent 330 (e.g., secure recordingsor auditing data and other records) can be retrieved by one or more ofthe personal communication nodes, or by other computer systems, at alater time using a new instance of intelligent agent 330 or throughother user interface elements.

FIG. 4 illustrates computing system 400, which can be an example of acomputing environment that executes intelligent agent and/or otherfeatures of node 106, management system 120 and/or agent system 130 ofFIG. 1. Furthermore, elements of computing system 400 can be distributedover one or more computing devices. Computing system 400 includesprocessing system 401, storage system 402, software 403, communicationinterface system 407, processing circuitry 408, and user interfacesystem 409.

It may be understood that computing system 400 is generally intended torepresent one or more computing systems on which software 403 may bedeployed and executed in order to implement intelligent agent module 230of FIG. 2 or to operate as a personal communication node or a managementsystem. However, computing system 400 may also be suitable as anycomputing system on which software 403 may be staged and from which oneor both may be distributed, transported, downloaded, or otherwiseprovided to yet another computing system for deployment and execution,or yet additional distribution.

Communication interface system 407 may include communication connectionsand devices that allow for communication with other computing systemsover a communication network. Examples of connections and devices thattogether allow for inter-system communication may include networkinterface cards, antennas, power amplifiers, RF circuitry, transceivers,and other communication circuitry. The connections and devices maycommunicate over communication media to exchange communications withother computing systems or networks of systems, such as metal, glass,air, or any other suitable communication media.

User interface system 409 may include a keyboard, a mouse, a voice inputdevice, a touch input device for receiving a touch gesture from a user,a motion input device for detecting non-touch gestures and other motionsby a user, and other comparable input devices and associated processingelements capable of receiving user input from a user. Output devicessuch as a display, speakers, haptic devices, and other types of outputdevices may also be included in user interface system 409. In somecases, the input and output devices may be combined in a single device,such as a display capable of displaying images and receiving touchgestures.

User interface system 409 may also include associated user interfacesoftware executable by processing system 401 in support of the varioususer input and output devices discussed above. Separately or inconjunction with each other and other hardware and software elements,the user interface software and user interface devices may support agraphical user interface, a natural user interface, or any other type ofuser interface. In addition, user input made with respect to the userinterfaces may be input via user interface system 409.

Communication between computing system 400 and any other computingsystem may occur over a communication network or networks and inaccordance with various communication protocols, combinations ofprotocols, or variations thereof. Examples of such communicationnetworks include intranets, internets, the Internet, local areanetworks, wide area networks, wireless networks, wired networks, virtualnetworks, software defined networks, data center buses, computingbackplanes, or any other type of network, combination of network, orvariation thereof. Some communication protocols that may be usedinclude, but are not limited to, the Internet protocol (IP, IPv4, IPv6),the transfer control protocol (TCP), and the user datagram protocol(UDP), as well as any other suitable communication protocol, variation,or combination thereof.

Processing circuitry 408 can comprise one or more microprocessors andother processing circuitry that retrieves and executes software 403 fromstorage system 402. Processing circuitry 408 can be implemented within asingle processing device but can also be distributed across multipleprocessing devices or sub-systems that cooperate in executing programinstructions. Examples of processing circuitry 408 include generalpurpose central processing units, application specific processors, andlogic devices, as well as any other type of processing device,combinations, or variations thereof. In some examples, portions ofprocessing circuitry 408 is physically separate from some elements ofcomputing system 400 and area included in remote servers, cloud-basedprocessing systems, or virtualized computing systems.

Storage system 402 can comprise any non-transitory computer readablestorage media capable of storing software 403 that is executable byprocessing circuitry 408. Storage system 402 can also include variousdata structures which comprise one or more databases, tables, lists, orother data structures. Storage system 402 can include volatile andnonvolatile, removable and non-removable media implemented in any methodor technology for storage of information, such as computer readableinstructions, data structures, program modules, or other data. Storagesystem 402 can be implemented as a single storage device but can also beimplemented across multiple storage devices or sub-systems co-located ordistributed relative to each other. Storage system 402 can compriseadditional elements, such as a controller, capable of communicating withprocessing circuitry 408. Examples of storage media include randomaccess memory, read only memory, magnetic disks, optical disks, flashmemory, virtual memory and non-virtual memory, magnetic cassettes,magnetic tape, magnetic disk storage or other magnetic storage devices,or any other medium which can be used to store the desired informationand that can be accessed by an instruction execution system, as well asany combination or variation thereof.

Software 403 can be implemented in program instructions and among otherfunctions can, when executed by computing system 400 in general orprocessing circuitry 408 in particular, direct computing system 400,processing system 401, or processing circuitry 408 to operate asdescribed herein for a management node, personal communication node, oran intelligent agent node, among others. Software 403 can includeadditional processes, programs, or components, such as operating systemsoftware, database software, or application software. Software 403 canalso comprise firmware or some other form of machine-readable processinginstructions executable by elements of processing system 401, such asprocessing circuitry 408.

In at least one implementation, the program instructions can includeattributes module 405, group module 406, and assistant module 410 (othermodules can be implemented as well). Attributes module 405 obtains(e.g., monitors, collects or receives) attribute information (e.g., oneor more attributes) of personal communication nodes and receives ortransfers messages for delivery to a management system or the like(e.g., indicating at least dynamic changes in the one or moreattributes). This attribute information (e.g., attributes and dynamicchanges in attributes) can be used to form and change dynamiccommunication groups among personal communication nodes and intelligentagent nodes. Attributes module 405 may periodically or continuouslymonitor attributes associated with personal communication node sensorsor personal communication nodes may send messaging or alerts toattributes module 405 when changes are detected.

Group module 406 monitors group membership status among personalcommunication (and possibly other) nodes and changes the groupmembership of personal communication nodes (e.g., based at least on theattributes and group membership status). Assistant module 410 maycomprise an intelligent agent, such as intelligent agent 230 of FIG. 2.Assistant module 410 can include voice recognition functions, assistantfunctions, audit functions, record functions, security functions andothers. In addition, software 230 may include operating systems,utilities, drivers, network interfaces, applications, or some other typeof software.

In general, software 403 can, when loaded into processing circuitry 408and executed, transform processing circuitry 408 from a general-purposecomputing system into a special-purpose computing system customized tooperate as described herein for a management node, personalcommunication node, or agent node, among other operations. Encodingsoftware 403 on storage system 402 can transform the physical structureof storage system 402. The specific transformation of the physicalstructure can depend on various factors in different implementations ofthis description. Examples of such factors can include, but are notlimited to the technology used to implement the storage media of storagesystem 402 and whether the computer-storage media are characterized asprimary or secondary storage. For example, if the computer-storage mediaare implemented as semiconductor-based memory, software 403 cantransform the physical state of the semiconductor memory when theprogram is encoded therein. For example, software 403 can transform thestate of transistors, capacitors, or other discrete circuit elementsconstituting the semiconductor memory. A similar transformation canoccur with respect to magnetic or optical media. Other transformationsof physical media are possible without departing from the scope of thepresent description, with the foregoing examples provided only tofacilitate this discussion.

FIG. 5 illustrates communication system 500 as a further example ofpersonal communication nodes employing one or more intelligent assistantagents. System 500 includes personal communication nodes 501-504, agents510-511, and cloud system 530. Personal communication nodes 501-504 maybe examples of nodes 102-104 of FIG. 1 and/or node 201 of FIG. 2, thoughvariations are possible. Agents 510-511 may be examples of node 106 ofFIG. 1 or intelligent agent 230 of FIG. 2, though variations arepossible. FIG. 5 omits any management system(s) for clarity.

In operation, nodes 501-504 form a communication group, examples ofwhich are discussed herein, that may be created, changed, and/orterminated based on attribute information. Nodes 501-504 establish asecure communication link 520 between each other (e.g., a secure tunnelor encrypted link). During audible or other communications of nodes501-504, intelligent agent features may be requested or desired, such asrecording audio or performing search functions.

Node 502 instantiates agent 511 which comprises a virtual machine 531(which can include elements discussed above for system 210 of FIG. 2)executed in cloud system 530. In this example, agent 511 performs asecurity handshaking process, is included in the secure link 520 and canthus communicate with any of nodes 501-504. Node 504 instantiates agent510 which also comprises a virtual machine 531 executed in cloud system530. Agent 510 performs security handshaking and is included in securelink 520. In this example, agent 510 can securely record voicecommunications and transcriptions of the voice communications into datastorage element 532. Furthermore, either agent 510-511 can perform otherintelligent agent functions, such as transcribing media received by anyof nodes 501-504, searching responsive to queries for information, orother personal assistant functions described herein. Likewise, eitheragent 510-511 can also perform communication group context-awarefunctions, such as paging of nodes in other communication groups,locating of nodes in a communication group, or other functions based oncommunication group context.

The included descriptions and figures depict specific embodiments toteach those skilled in the art how to make and use the best mode. Forthe purpose of teaching inventive principles, some conventional aspectshave been simplified or omitted. Those skilled in the art willappreciate variations from these embodiments that fall within the scopeof the invention. Those skilled in the art will also appreciate that thefeatures described above may be combined in various ways to formmultiple embodiments. As a result, the invention is not limited to thespecific embodiments described above, but only by the claims and theirequivalents.

What is claimed is:
 1. A method of managing a communication group,wherein the communication group comprises a plurality of personalcommunication member nodes, the method comprising: receivinginstructions from at least one of the plurality of personalcommunication member nodes to instantiate an intelligent agent;instantiating the intelligent agent as a virtual assistant communicationmember node in the communication group; and the instantiated intelligentagent transcribing communications among and between the plurality ofpersonal communication member nodes in the communication group.
 2. Themethod of claim 1 wherein receiving instructions to instantiate theintelligent agent comprises receiving voice instructions through a firstpersonal communication member node in the communication group.
 3. Themethod of claim 1 wherein the intelligent agent is instantiated througha security handshake procedure to provide secure access to theintelligent agent by the plurality of personal communication nodemembers as a secure communication member node in the communicationgroup.
 4. The method of claim 1 wherein the instantiated intelligentagent transcribing communications among and between the plurality ofpersonal communication member nodes comprises one of the following:audio transcription of non-audio communications; or textualtranscription of audio communications.
 5. The method of claim 1 whereinthe intelligent agent is instantiated as a virtual assistantcommunication member node in the communication group by a virtualmachine in a cloud system.
 6. The method of claim 1 wherein theintelligent agent is instantiated as a virtual assistant communicationmember node in the communication group by a management system configuredto define the communication group based on attribute informationtransferred to the management system from the plurality of personalcommunication member nodes in the communication group.
 7. The method ofclaim 1 wherein each personal communication member node in the pluralityof personal communication member nodes comprises a wearable push-to-talkcommunication device.
 8. A non-transitory computer readable storagemedium having a distributed group communications application storedthereon, the distributed group communication application includinginstructions, which when executed by one or more processors of a groupcommunication system, cause the group communication system to: receiveinstructions from at least one of a plurality of personal communicationmember nodes operating as a communication group to instantiate anintelligent agent; and instantiate the intelligent agent as a virtualassistant communication member node in the communication group, whereinthe instantiated intelligent agent is configured to transcribecommunications among and between the plurality of personal communicationmember nodes in the communication group.
 9. The non-transitory computerreadable storage medium of claim 8 wherein the instructions toinstantiate an intelligent agent comprise voice instructions received bya first personal communication member node in the communication group.10. The non-transitory computer readable storage medium of claim 8wherein the intelligent agent is instantiated through a securityhandshake procedure to provide secure access to the intelligent agent bythe plurality of personal communication member nodes as a securecommunication member node in the communication group.
 11. Thenon-transitory computer readable storage medium of claim 8 wherein theinstantiated intelligent agent transcribing communications among andbetween the plurality of personal communication member nodes comprisesone of the following: audio transcription of non-audio communications;or textual transcription of audio communications.
 12. The non-transitorycomputer readable storage medium of claim 8 wherein the intelligentagent is instantiated as a virtual assistant communication member nodein the communication group by a virtual machine in a cloud system. 13.The non-transitory computer readable storage medium of claim 8 whereinthe intelligent agent is instantiated as a virtual assistantcommunication node in the communication group by a management systemconfigured to define the communication group based on attributeinformation transferred to the management system from the plurality ofpersonal communication member nodes in the communication group.
 14. Thenon-transitory computer readable storage medium of claim 8 wherein eachpersonal communication member node in the plurality of personalcommunication member nodes comprises a wearable push-to-talkcommunication device.
 15. A method of operating a group communicationsystem, comprising: managing a communication group comprising aplurality of personal communication member nodes, wherein each personalcommunication member node comprises a user node transmitting andreceiving communications between the group members; receivinginstructions from at least one of the plurality of personalcommunication member nodes to instantiate an intelligent agent;instantiating the intelligent agent as a virtual assistant communicationmember node of the communication group, wherein the virtual assistantcommunication member node performs transcription services for thecommunication group member nodes.
 16. The method of claim 15 wherein thecommunication group is defined by a management system based on attributeinformation transferred to the management system by the member nodes andis updated based on changes to the attribute information.
 17. The methodof claim 16 wherein the instructions to instantiate the intelligentagent are voice instructions received by a first communication membernode that is a member of the communication group.
 18. The method ofclaim 15 further comprising storing transcribed communications.
 19. Themethod of claim 15 wherein the instantiated intelligent agent performingtranscription services for the communication group member nodescomprises one of the following: performing audio transcription ofnon-audio communications; or performing textual transcription of audiocommunications.
 20. The method of claim 15 wherein communicationsbetween the communication group member nodes are encrypted and furtherwherein the virtual assistant communication member node is securelylinked to the communication group.